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We discuss the consequences of a variant of the Hatano-Sasa relation in which a non-stationary 
distribution is used in place of the usual stationary one. We first show that this non-stationary 
distribution is related to a difference of traffic between the direct and dual dynamics. With this 
formalism, we extend the definition of the adiabatic and non-adiabatic entropies introduced by M. 
Esposito and C. Van den Broeck in Phys. Rev. Lett. 104, 090601 (2010) for the stationary case. 
We also obtain interesting second-law like inequalities for transitions between non-stationary states. 



Introduction- The second law of thermodynamics pro- 
vides fundamental limitations on the way transitions be- 
tween equilibrium states can occur. For many years, this 
principle could only be expressed as an inequality. A 
broad number of works summarized under the name of 
fluctuations theorems (FT) [l|, Q , have changed that fun- 
damentally by providing equalities valid for systems arbi- 
trarily far from equilibrium. In particular, one equality 
defines the entropy production as the amount of time- 
symmetry breaking [3|, a statement which not only en- 
compasses the second law, but also sharpens it by provid- 
ing additional implications at the trajectory level. This 
notion of trajectories is also meaningful for stochastic 
optimization problems Q and more generally for appli- 
cation to information theory. In this respect, the recent 
generalization of the Jarzynsky relation for systems op- 
erating under feedback control Q appears particularly 
significant. With all these exciting developments, the sec- 
ond law of thermodynamics, a rather old idea, appears 
nowadays more alive than ever. 

In these generalizations, an essential step was made by 
Hatano and Sasa Q , who introduced the functional 



Athtdh4>{ct, ht), 



(1) 



where (f){c,h) = — In pst(c, /i), and Pst{c,h) is the sta- 
tionary probability distribution to be in a microstate c 
with a constant value of the control parameter h. They 
have shown that (exp(— y[c])) = 1, a relation which has 
been confirmed experimentally with small colloidal sys- 
tems 0. Their relation implies (Y) > 0, which translates 
into a modified second-law for transitions between non- 
equilibrium steady states (NESS) Q, and through an ex- 
pansion it also leads to a modified fluctuation-dissipation 
theorem for systems near a NESS Q . In this framework, 
in the limit of very slow driving, the probability distri- 
bution assumes at all times its stationary form evaluated 
at the value of the control parameter at this time. In 
contrast to this, we develop in this paper a framework 
for situations in which even in the limit of slow driving 
the probability distribution stays time-dependent. This 



extension is important to treat the following situations: 
(i) the system never reaches a stationary state on any 
reasonable time scale, as in aging systems, (ii) the sys- 
tem is driven by at least two control parameters, so even 
when the protocol h is constant the dynamics remains 
non-stationary, or (iii) the system is prepared in a non- 
stationary distribution by the choice of initial conditions 
and is then further driven. In it was shown that re- 
markably, when a stationary distribution is used as ref- 
erence, the second law can be split into two components, 
the so called adiabatic part (corresponding to the con- 
tribution of the entropy production in the limit of slow 
driving) and the remaining non-adiabatic part. In this 
paper, we ask whether in the particular situations men- 
tioned above, the second law can still be split into two 
components similar to the adiabatic and non-adiabatic 
entropy productions. 

In order to investigate this question, we consider a sys- 
tem which evolves according to a continuous-time Marko- 
vian dynamics of a pure jump type. We denote a trajec- 
tory by [c] = (co, ci, Cat; Ti, .., tn) where the Ci are the 
states which are visited by the system and Ti are the 
jumping times to go from Ci-i to Ci. This trajectory 
is recorded from time to time T. The transition rate 
to jump from a configuration c to a configuration c' is 
denoted i(jf*(c, c'). In this notation, the superscript ht 
refers to the dependance on the driving protocol, while 
the subscript t refers to an additional time-dependence 
not related to the protocol h. The path probability for 
this trajectory is 



'P[c\ = Po(co) 



X cxp 




da^(Cj_i) \ wrj' (Cj_l,Cj) 
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where Xt*{c') — X^c^^c' ^f* (^'j c) represents the escape 
rate to leave the state c' and po(co) is the probability 
distribution of the initial condition cq. Let us consider a 
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logratio of path probabilities of the form: 
AA[c] 



nc*] 

where V results from the application of an involu- 
tion on the path probability V, while [c*] = 
{cq, cl, c^;ti , ..,T^) results from a different involu- 
tion acting on the trajectory [c]. In the following, 
we assume that the involution * is either the identity 
([c*] = [c]) or the time-reversal symmetry ([c*] = [c] = 
{cn,cn-i,-,co;T - TN,.;T - Ti)). By computing the 
logratio of these probabilities, one finds that 



AA\c] = In 



Po(co) 



N h 
Sr^^^ Wr, (Cj-l,Cj) 

3 = 1 W^.^ (c*_i,C*) 



TTt{c,ht) depends only on the driving at time t unlike 
Pt(c, [ht]), the solution of the master equation with the 
(3) same initial condition but with the generator ij*' , which 
depends functionally on the driving history [ht] up to 
time t. Using the duality transformation introduced 
above, we consider the following two cases for the invo- 
lutions entering in Eq. |3l Case (A) where the involution 
^ is the combination of duality plus time reversal (a) 
and * is the time reversal, with A^[c] = AA„a[c]; and 
case (B) where the involution ~ is the duality (A) and * 
is the identity, and A^[c] = ABa[c]. In both cases, the 
integral in the r.h.s of Eq. |3]is the same and, using Eq. [5] 
and Eq. [3 it can be written as 



d^(A^(Q)-A^(ct)) = - / dt{dt\mrt){ct,ht). 
Jo 



(4) 



■^T^-t if the invo- 



with Ct = Cj if f € [rj,rj_|_i[ and A: 
lution * is the time reversal. Note that the second term 
in A^[c] corresponds to a difference of traffic (i.e. time 
integrated escape rates) between the dynamics generated 
by V and that generated by V, and has similarities with 
the dynamical activity introduced in Ref. [lo| . 

Now introducing P{AA) = Y.[c] ^(^-^ " AA[c])P[c], 
and using the relation A^[c] — —AA[c*], which follows 
from Eq. [3l one obtains a detailed fluctuation theorem 
(DFT) for AA, namely 



PiAA) - exp (A^) P(-A^). 



(5) 



As a first application of Eq. 21 we choose the involution 
star to be the time-reversal symmetry and the involution 
tilde to be the time-reversal for the rates that we denote 
with a bar, such that w!^^{c,c') = WjZT^^ {c, c'). In this 
case, the second term in Eq. S] is zero, and A^ repre- 
sents the total entropy production, AStot, which satisfies 
a DFT of the form above [ui- 

First main result- We now introduce a new involution, 
namely the duality transformation, that we denote by a 
hat (a). In analogy with the stationary case Q , we define 
the dual dynamics by the following transformation of the 
rates: 



W^{c' , c)TTr{c', h) 
TTr{c,h) 



(6) 



where the distribution ttj (c, h) represents the probability 
to observe the system in the state c at a time t > in 
the presence of a constant (time independent) driving h. 
This distribution, which plays a key role here satisfies 



^) [c,h) = Y.''^{c\h)L^,{c\c), 



(7) 



where is the generator defined by L^{c',c) = 
Wf{c',c) — S{c,c')^^„ uj^{c' ,c"). We emphasize that 



(8) 

We call that quantity AT[c] in the following. Note that 
in Eq. [51 the time derivative acts only on In tt^ , but not 
on the arguments of that function. This relation is our 
first result. It establishes an important link between the 
difference of traffic associated with the direct and dual 
dynamics and the accompanying distribution 7rt(c, ht). 

Second main result- We now show that using the quan- 
tity AT we can generalize the notions of adiabatic and 
non-adiabatic contribution to the total entropy produc- 
tion, denoted respectively ASa and ASna- We define 
them to be 



AS„ 



In 



Po(co) 



Pt{ct, [hx] 



Y^l^^J^fllM^^ (9) 

3 = 1 

A^.M-y:in "\^'^-^''^^"^^'^-^'"^-^ (10) 



7rrj(Cj-l, hr^) ' 



J = l 



Wr/ (Cj, Cj_i)7rT-^. (Cj, hr^) 



where tt^ (c, h) replaces again the stationary distribution 
in the usual definition . These two quantities are such 
that AStot = ASa + ASna- Since AStot can be further 
split into reservoir entropy ASr and system entropy with 
AS* = Inpo(co) — lnpT(cT, [/jt]), one can introduce an 
excess entropy ASex such that AS",. = ASa + A^e^; and 
ASna = AS* + ASex- Unfortunately, the splitting into 
adiabatic and non-adiabatic contributions does not have 
in general the property that each term satisfies a DFT, 
although the joint distribution of ASa and ASna satisfies 
such a relation Nonetheless, being of the form of 

Eq. El AAna = ASna " AT and ABa = ASa - AT do 
verify separately a DFT 



In 



P{AAna) 
P{-AAna) 



AA 



In 



PjABg) 
P{-ABa) 



= AB„ 



(11) 

These relations represent the second main result of this 
paper, which we now discuss in more details: 

Let us assume that the driving starts at time tdi > 
and ends at time f^/ < T for a total duration t^ = t^f — 
tdi - When TTt (c, h) relaxes very quickly to the stationary 
distribution (on a time scale Tst such that r^t T and 



3 



Tst ^ td), one recovers from Eq. [9] and Eq. [10] the usual 
definitions of the non-adiabatic and adiabatic parts of 
the entropy production. In this case AT ~ 0, and Eq.fTD 
become the usual detailed fluctuation theorems satisfied 
by the adiabatic and non-adiabatic entropies Q. 

We notice now that A Ana = ASb + , where ASb = 
AS — Alp is a boundary term, with Atp = ln7ro(co, ho) — 
InTTTicT, hr) and 



This quantity is the exact analog of Eq. [Tl when the 
stationary distribution pst (c, h) is replaced by -Kt (c, h) = 
exp(— -0((c, h)). Then, a consequence of Eq.[TT]is that the 
functional [Vt satisfies a generalized Hatano-Sasa relation 

(exp(-3^T[c])) = l (13) 

when we consider transitions between non-stationary 
states, that is to say when the time T is such that 
T — td^ T where t is the relaxation time of pt(c, [ht]) to- 
wards 7rf(c, /it). Since po(co) = 7ro(co, /io)i in this case the 
boundary term ASb vanishes. We note that by expanding 
Eq. [13] we have a modified fluctuation-dissipation the- 
orem valid for systems near a general non-equilibrium 
state [ll,[il. 

Note also that the remaining parts in the entropy 
production AAa = AStot — AAna = ASa + AT and 
ABna = AStot ~ ABa = ASna + AT do uot Satisfy a 
DFT of the form of Eq. [5] except in the stationary case 
due to the fact that in this case AT = 0. 

Third main result- Using the Jensen's inequality on in- 
tegrated fluctuation theorem associated to EqfTl] we get 
(AAna) > and {ABa) > 0. We can equivalently write 
that {ASna) > (AT) and {ASa) > {AT), which taken 
together imply {AStot) > max(2(AT), 0). These inequal- 
ities are very general, they hold for Markov processes in 
finite time T, arbitrary initial probability distribution poi 
arbitrary driving and arbitrary dynamics of the system 
at constant time-independent driving. Note that there is 
no lower bounds for AAa or AB„a, which need not be 
positive on average. That this should be the case can 
be understood by considering a system at equilibrium on 
which two protocols that exactly compensate each other 
are applied and only the second protocol is considered as 
driving. In this case, the system is in equilibrium at all 
times, the rates satisfy a detailed balance condition, and 
{AStot) = 0. Therefore, {AAa) < and {ABna) < 0. 

From the inequality {AAna) > 0, one obtains 

{AS)>-{ASe.) + {AT), (14) 

which contains the second law for transitions between 
equilibrium states and the modified second law for tran- 
sitions between NESS @, 01 as particular cases. For this 
reason, we call Eq. [14] a modified second law for transi- 
tions between non-stationary states. Alternatively, one 
has also (3^t) > -{ASb) = D{pT\\TrT) > 0. The equality 
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FIG. 1. Illustration of the detailed fluctuation theorem sat- 
isfied by yr, namely Eq. Illl in the particular case that 
AA„a = Vt and for the dynamics of a two states model. The 
square symbols corresponds to a fast relaxation as compared 
to the driving, whereas the opposite is true for the circles. 



in these relations holds in the adiabatic limit, correspond- 
ing to infinitively slow driving on ht in which case pt has 
relaxed towards ttt and thus {ASb) = 0. In this limit, 
AAna = which justifies the adiabatic/non- adiabatic 
terminology; AAa ABa = AStot and ABna = 0. 
Taken together, these relations imply that AT = and 
that the second equation in Eq. [TT] becomes the DFT 
satisfied by the total entropy production. Clearly, the 
driving can be slow even if T:t{c, ht) has not relaxed to a 
stationary distribution. Note also, that in this adiabatic 
limit, the Shannon entropy constructed from ■Kt{c,h), 
namely {Aip) equals the opposite of the excess entropy 
— {ASex) as in the case of NESS. 

Example- As an illustrative example, we consider a 
time-dependent two states model, which may be realized 
experimentally in quantum optics for instance [T5| . We 
have chosen for simplicity rates of the form (a, b) = 
^(a, &)e~'''/^ and w^*{b,a) — w(6, a)e''*/^, where the 
driving ht follows a time-symmetric half sinusoidal pro- 
tocol of duration td = T . The initial probability to be 
in one of the two states is chosen according to an ar- 
bitrary value different from the stationary value (here 
we chose arbitrarily po(^) = 0.9). Therefore, the ref- 
erence dynamics is non stationary by the choice of ini- 
tial condition. Through extensive kinetic Monte Carlo 
simulations of the trajectories followed by this system, 
we determine the distributions 7rt(c, /i), the correspond- 
ing dual dynamics, and the distribution of 3^t from this 
data. Figure [I] shows that the first DFT of Eq. [IT] is 
well obeyed in this case irrespective of whether the re- 
laxation of the TTt distribution is fast or not with re- 
spect to the driving. Figure [5] illustrates transitions 
between two non-stationary states. The non-stationary 
states at given h are created by sinusoidal reference 
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dthtdhiptict, ht). 
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FIG. 2. Driving entropy production (3^t), non adiabatic en- 
tropy production (ASna) and (AT) as function of the dura- 
tion of the driving td- The inset represents the total driving 
protocol, with the oscillating part at pulsation uq representing 
the reference and the solid line representing a linear protocol 
ht which is on between times tdi and tdf- 



protocols with rates w'f;{a,h) = ti;(a, 6)e^''^^'"'^"' and 
Wf{b,a) = w{b, a)e^^^"^'^°* . The transition is produced 
by a pieccwisc linear driving protocol ht as shown in the 
inset of the figure. The various quantities (^t), (AS'na) 
and (AT) are shown as a function of the duration of the 
driving td- As expected, in the quasistatic limit oo, 



one has (AT) = (3^t) = (AS'na) = 0, whereas td 
corresponds to a quenched limit which is consistent with 
{ASna) - (AT) = {yr)- Note that the general evolu- 
tion of (yr) as function of td is similar to that of the 
dissipated work in the equilibrium case Q . 

In this particular example, we have chosen a simple 
dynamics for which the distribution TTt (c, h) is analyti- 
cally solvable. More generally for applications in complex 
systems, this distribution will not be available analyti- 
cally, however if the system (or sub-system) of interest is 
of small size, the numerical determination of this distri- 
bution is possible through simulations [l^l- Among the 
various strategies which can facilitate this numerical de- 
termination, one recent suggestion is to determine the 
distribution iteratively by starting from an approximate 
ansatz function [l6j . 

Conclusion- We have connected the accompanying dis- 
tribution 7r((c, ht) introduced in [ij] to the difference of 
traffic between the direct and dual dynamics. Using a 
non-stationary probability as reference, we have extended 
the notion of adiabatic and non-adiabatic contribution 
to the total entropy production. Unfortunately, the two 
new parts of the total entropy production do not verify 
separately a DFT as in the stationary case. Despite this, 
we have obtained two detailed fluctuation theorems with 
interesting consequences: a generalization of the Hatano- 
Sasa relation and second-law like inequalities for transi- 
tions between non-stationary states. These results could 
have important applications in particular in force mea- 
surements with biopolymers or proteins, for the charac- 
terization of small glassy systems, or for stochastic opti- 
mization problems. 
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